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DETAILED ACTION 



Continued Examination Under 37 CFR 1.114 



1 . A request for continued examination under 37 CFR 1.114, including \he fee set 
forth in 37 CFR 1.17(e), was filed (September 30, 2005) in this application after final 
rejection. Since this application is eligible for continued examination under 37 CFR 
1.114, and the fee set forth in 37 CFR 1 .17(e) has been timely paid, the finality of the 
previous Office action has been withdrawn pursuant to 37 CFR 1.114. Applicant's 
submission (after/final. amendment) filed on August 31, 2005 has been entered. 



Claim Rejections - 35 USC § 103 



2. The following is a quotation of 35 U.S.C. 103(a) which forms the basis for all 
obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set 
forth in section 1 02 of this title, if the differences between the subject matter sought to be patented and 
the prior art are such that the subject matter as a whole would have been obvious at the time the 
invention was made to a person having ordinary skill in the art to which said subject matter pertains. 
Patentability shall not be negatived by the manner in which the invention was made. 



3. Claims 1-3, 8, 12, 13, 16, 20-22, 24, 28, and 29 are rejected under 35 U.S.C. 
103(a) as being unpatentable over Ishikawa et al. (US 5,862,264), in view of Fu et al 
(US 5,703,965), Fan (US 5,495,538) and Acharya et al. (US 6,229,578). 
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4. Regarding claim 1 , and similarly claims 8, 16, 28 and 29, Ishikawa discloses 

• extracting edge information which represents an edge part of said 
original image 

[Fig. 1, ref. 14) 

• obtaining density information of an edge smoothed image from said 

original image by smoothing said edge part 

[Fig. 1, ref. 11; Figs. 6, 7; Col. 1, lines 34-37. Note that edges are 
smoothed in the process] 

• obtaining coded edge information by coding said edge information 
according to first coding algorithm 

[Fig. 1, ref. 16] 

• obtaining coded density information by coding said density information 
of said edge smoothed image according to second coding algorithm 
[Fig. 1, ref. 13] 

• sending said coded edge information and said coded density information 
as said coded information to said image decoding apparatus 

[Fig. 1] 

• obtaining said edge information by decoding said coded edge information 
according to a first decoding algorithm corresponding to said first 
coding algorithm 

[Fig. 1, ref. 22] 

• obtaining said density information of said edge smoothed image by 
decoding said coded density information according to second decoding 
algorithm corresponding said second coding algorithm 

[Fig. 1, ref. 21] 



Ishikawa does not expressly disclose that the edge information is binary and that 
the density information is obtained using said edge information, nor the following 

• obtaining said reproduced image from said density information of said 
edge smoothed image by sharpening said edge part of said edge smoothed 
image by using said edge information 

• wherein said second algorithm and said second decoding algorithm are 
based on a standard coding method using a discrete cosine transform 



However, Fu teaches/suggests using decoded edge information to sharpen decoded 
density image [Fig. 5, refs. 402, 500; Figs. 12, 13; Col. 18, line 46 - Col. 19, line 28]. 
Further, Fan discloses using DCT to code (and therefore decode) a smoothed image 
[Abstract]. 
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In addition, Acharya discloses an edge-detection operation that represents the result as 
binary information (edge/non-edge) [Figs. 1 & 4] and obtaining density information of an 
edge-smoothed, image using the edge information [Fig. 6]. 

Ishikawa, Fu, Fan and Acharya are combinable because they are from the same field of 
endeavor of compression/decompression and/or image smoothing (relevant since it can 
improve compression results and is used by Ishikawa). 

At the time of the invention, it would have been obvious to one of ordinary skill in the art 
to modify Ishikawa with the teachings of Fu, Fan and Acharya by using binary 
representation of edge information, using decoded edge information to sharpen the 
edge part of the decoded density image and using DCT for the second encoding and 
decoding algorithms. The motivation for doing so would have been to reduce the size of 
the compressed edge information (since binary image typically has a larger 
compression ratio); to enhance the perceptual quality of the reconstructed image, as 
indicated in Col. 4, lines 34-36 of Fu; as well as the wide acceptance of the DCT as a 
basic ingredient of compression standards such as JPEG and MPEG and the 
availability of software and hardware implementation of such standards (e.g., Fan, Col. 
1 , lines 30-52 and Col. 2, lines 5-8). 

Therefore, it would have been obvious to combine Fu, Fan and Acharya with Ishikawa 
to obtain the invention of claim 1 . 
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Regarding claim 2, and similarly claim 12, Ishikawa further discloses 

performing first matrix operation by using a first block density 
information vector and smoothing matrix, wherein said first block 
density information vector is obtained by arranging density information 
of each pixel included in a first block, said first block includes a 
pixel in said edge part or in a near region of said edge part and 
includes pixels in a surrounding region around said pixel, and order of 
said first block density information, vector corresponds to the number 
of pixels in said first block, and wherein said smoothing matrix 
includes coefficients used for edge smoothing which operate on density 
information of each pixel in said first block 

[Fig. 6 (smoothing matrix); Fig. 7 (the block on the left is the first 
block)] 

obtaining smoothed density information of each pixel by overlaying 
density information of each pixel in said first block obtained by 
performing said first matrix operation on each pixel while scanning said 
original image pixel by pixel 
[Figs. '6, 7; Col. 7, lines 34-37] 



6. Claim 3, and similarly claims 20 and 21 , is drawn to the application of the 

» 

sharpening operation, which is identical to the application of the smoothing operation 
recited in claim except for the matrix used. Since it is well known in the art that 
sharpening is essentially the inverse of smoothing, therefore it would have been obvious 
to one of ordinary skill in the art to use the inverse matrix of the smoothing matrix for the 
sharpening operation. Along with this, claim 3 is similarly analyzed and rejected as per 
claim 2. 



7. Regarding claim 1 3, Acharya further discloses 

• a pixel judgment part for judging whether a pixel exists in said edge 
part or in a near region of said edge part while scanning said original 
image pixel by pixel 

• the matrix operation part for performing, when said pixel exists in said 
edge part or in said near region 
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[Fig. 1, refs. 140 (edge detection) & 150 (edge-smoothing). Note that 
smoothing by averaging can be implemented as a matrix operation, as 
taught by Ishikawa (e.g., per the analysis of claim 2)]. 

8. Regarding claim 22, it is the reverse (i.e.. decoding) of the coding apparatus of 
claim 13 and therefore is rejected based on obviousness. 

9. Claim 24 is similarly analyzed as per the analyses of claims 3 and 22. 
*** 

10. Claims 4-6, 15, 25 and 26 are rejected under 35 U.S.C. 103(a) as being 
unpatentable over Ishikawa et al. (US 5,862,264), Fu et al. (US 5,703,965), Fan (US 
5,495,538) and Acharya et al. (US 6,229,578) as applied to claims 1-3, 8, 12, 13, 16, 
20-22, 24, 28, and 29, and further in view of Murakami et al. (US RE35,414). 

1 1 . Regarding claim 4, and similarly claim 15, the combined invention of Ishikawa, 
Fu, Fan and Acharya discloses all limitations of its parent, claim 1 . 

The combined invention of Ishikawa, Fu, Fan and Acharya does not expressly disclose 
that said image coding apparatus smoothes said edge part by performing the steps of: 

• obtaining density information x' of a pixel of said edge part of said 
edge smoothed image according to a first equation x*==(l~X)x+ XC) , 
wherein, A is a positive constant, x is density information of said 
pixel of said original image, and C is surrounding density information 
representing density state of surrounding region of said pixel 
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However, Murakami teaches/suggests using a weighted filter as described above to 
perform the smoothing operation [Fig. 40; Fig. 42, ref. 117; Col. 27, lines 55-65; Col. 29, 
lines 47-50.]. 

The combined invention of Ishikawa, Fu, Fan and Acharya is combinable with Murakami 
because they are from the same field of endeavor of compression/decompression. 

» 

At the time of the invention, it would have been obvious to one of ordinary skill in the art 
to modify the combined invention of Ishikawa, Fu, Fan and Acharya with the teaching of 
Murakami by using the specific smoothing filter. The motivation for doing so would have 
been because it is effective, easy to implement, and most important, adaptive. [See 
Col. 27, line 66 - Col. 28, line 13 on the adaptive feature.] 

Therefore, it would have been obvious to combine Murakami with Ishikawa, Fu, Fan and 
Acharya to obtain the invention of claim 4. 

12, Regarding claims 5 and 6, note that from the first equation recited in claim 4, x 
can be expressed as (x' - AC)/ (1-A) which is the inverse of the smoothing operation 
performed using the first equation and per the analysis of claim 3, is an obvious choice 
for sharpening. Moreover, given the smoothed edge density information (i.e., x'), x" = 
(x'.- AC)/ (1-A) is an obvious estimate of the original x, which of course is the best 
sharpening result that can be obtained (in the sense of restoring the compressed image 



Application/Control Number: 1 0/003, 113 Page 8 

Art Unit: 2625 

with the highest fidelity). On the other hand, the predetermined equation e(X) = (X+ 
(AC(n) - x')/ (1-A))^ recited in claim 6 expresses the well-known squared errors of a 
value X and its estimate Z = (x' - AC(n))/ (1-A) and can be minimized using the also 
well-known steepest-descent approach. 

Therefore, it would have been obvious to one of ordinary skill in the art to use the 
steepest-descent approach to determine the X that minimizes e(X). Claims 5 and 6 are 
therefore rejected due to obviousness. 

(Examiner's comment: Note, however, in this special case it is clear that when C(n) is 
chosen in the obvious manner such that C(n) = C (as defined in the first equation), x" 
will minimize e(X) because 

e(x") = (x"+ (AC - X')/ (1-A))^ = ((X' - AC)/ (1-A)+ (AC - x')/ (l-A))^ = 0.) 

* 

13. Claim 25 is similarly analyzed and rejected as per the analyses of claims 4 and 5. 

14. Claim 26 is similarly analyzed and rejected as per the analysis of claim6. 
*** 

15. Claims 7 and 27 are rejected under 35 U.S. C. 103(a) as being unpatentable over 
Ishikawa et al. (US 5,862,264), Fu et al. (US 5,703,965), Fan (US 5,495,538), Acharya 
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et al. (US 6,229,578) and Murakami et al. (US RE35,414) as applied to claims 4-6, 15, 
25 and 26, and further in view of Webb et al. (US 6,621 ,909). 

16. Regarding claim 7, and similarly claim 27, the combined invention of Ishikawa, 
Fu, Fan, Acharya, and Murakami discloses all limitations of its parent, claim 6. 

The combined invention of Ishikawa, Fu, Fan, Acharya, and Murakami does not 
expressly disclose 

• in a process according to said steepest-descent method, X is obtained as 
a convergence value of a recurrence formula 
X{n+1)= X(n)- G*(5e/5X) , wherein G is constant. 

However, Webb teaches/suggests obtaining X as a convergence value of a recurrence 
formula X(n+1)= X(n)- G*(5e/5X) , wherein G is constant. [See Col. 4, lines 32-67.] 

The combined invention of Ishikawa, Fu, Fan, Acharya, and Murakami is combinable 
with Webb because they solve the same optimization problem. 

At the time of the invention, it would have been obvious to one of ordinary skill in the art 
to modify the combined invention of Ishikawa, Fu, Fan, Acharya and Murakami with the 
teaching of Webb by obtaining X as a convergence value of a recurrence formula 
X(n+1)= X(n)- G*(6e/6X). The motivation for doing so would have been because it has 
been shown to be capable of minimizing the total magnitude square errors, as Webb 
indicated in Col. 4, lines 50-55. 
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Therefore, it would have been obvious to combine Webb W\ih Ishikawa Fu, Fan, , . 
Acharya and Murakami to obtain the invention of claim 7. 

17. Claims 9, 10, 17 and 18 are rejected under 35 U.S.C. 103(a) as being 
unpatentable over Ishikawa et al. (US 5,862,264), Fu et al. (US 5,703,965), Fan (US 
5,495,538) and Acharya et al. (US 6,229,578) as applied to claims 1-3, 8, 12, 13, 16, 
20-22, 24, 28, and 29, and further in view of Su (US 4,162,482). 

18. Regarding claim 9, the combined invention of Ishikawa, Fu, Fan and Acharya 
discloses all limitations of its parent, claim 8. 

The combined invention of Ishikawa, Fu, Fan and Acharya does not expressly disclose 

• said edge smoothing part including a density information correction part 
for correcting density information of each pixel such that variation of 
density levels represented by density information of pixels which are 
arranged across said edge part in a near region of said edge part of 
said original image is lowered 

However, Su teaches/suggests removing noise (i.e., performing correction) prior to 
smoothing the edges (and therefore is considered part of the smoothing) [Fig. 1 , refs. 5, 
9; Col. 3, lines 46-58]. 
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The combined invention of Ishikawa, Fu, Fan and Acharya is combinable with Su 
because they have aspects that are from the same field of endeavor of edge detection. 



At the time of the invention, it would have been obvious to one of ordinary skill in the art 
to modify the combined invention of Ishikawa, Fu, Fan and Acharya with the teaching of 
Su by removing noise (i.e., performing correction) prior to smoothing the edges. The 
motivation for doing so would have been to remove noise so as to obtain a better 
smoothing result. 



Therefore, it would have been obvious to combine Su with Ishikawa, Fu, Fan and 
Acharya to obtain the invention of claim 9. 



19. Regarding claim 10, Ishikawa further discloses 

• said density information correction part a mean value calculation part 
calculating mean value of said density levels in predetermined region; 
and a density level judgment part for judging whether said density level 
of a pixel is higher or lower than said mean value for each pixel in 
said near region; wherein density information is corrected for a pixel 
in which said density level is higher than said mean value such that 
said density level is lowered, and density information is corrected for 
a pixel in which said density level is lower than said mean value such 
that said density level increased 

[Figs. 6 and 7. Note that by replacing {i.e., correcting) a target 
pixel value with the average of its neighbors', the new mean will be 
lowered if the original target pixel value is higher than the original 
mean, and vice versa] 

20. Regarding claim 17, it is similarly analyzed and rejected as per the analysis of 
claim 9 because it is its decoding counter part and therefore is obvious and also 
because performing similar image correction can improve the sharpening result. 
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21 . Regarding claim 18, it is similarly analyzed and rejected as per the analysis of 
claim 10 because it is its decoding counter part and therefore is obvious. 

22. Claims 1 1 and 19 are rejected under 35 U.S.C. 103(a) as being unpatentable 
over Ishikawa et al. (US 5,862,264), Fu et al. (US 5,703,965). Fan (US 5,495,538), 
Acharya et al. (US 6,229,578) and Su (US 4,162.482) as applied to claims 9, 10, 17 and 
18, and further in view of Lee et al. (US 5,612,744). 

23. Regarding claim 1 1, the combined invention of Ishikawa, Fu, Fan, Acharya and 
Su discloses all limitations of its parent, claim 10. 

The combined invention of Ishikawa, Fu, Fan, Acharya and Su does not expressly 
disclose 

• wherein said density information correction part, corrects density 

inforination of each pixel in said near region such that said mean value 
of said density levels does change 

However, Lee teaches/suggests preserving mean values [Fig. 2, ref. 26; Col. 4, lines 
21-27. 
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The combined invention of Ishikawa, Fu and Fan, Acharya and Su is combinable with 
Lee because they have aspects that are from the same field of endeavor of edge 
detection. 

At the time of the invention, it would have been obvious to one of ordinary skill in the art 
to modify the combined invention of Ishikawa, Fu, Fan, Acharya and Su with the 
teaching of Lee by preserving the mean values. The motivation for doing so would have 
been because in this way the results will be more pleasing, as Lee indicated in Col. 4, 
lines 27-30. 

Therefore, it would have been obvious to combine Lee with Ishikawa, Fu, Fan, Acharya 
and Su to obtain the invention of claim 1 1 . 

24. Regarding claim 19, it is similarly analyzed and rejected as per the analysis of 
claim 1 1. because it is its decoding counter part and therefore is obvious. 



25. Claims 14 and 23 are rejected under 35 U.S.C. 103(a) as being unpatentable 
over Ishikawa et al. (US 5,862,264), Fu et al. (US 5,703,965), Fan (US 5,495,538) and 
Acharya et al. (US 6,229,578) as applied to claims 1-3, 8, 12, 13. 16, 20-22, 24, 28, and 
29, and further in view of Futamura (US 5,791,271). 
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26. Regarding claim 14, the combined invention of Ishikawa, Fu, Fan and Acharya 
discloses all limitations of its parent, claim 13. 

The combined invention of Ishikawa, Fu, Fan and Acharya does not expressly disclose 

• a distance conversion part for generating distance information 
representing distances between said edge part and each pixel 

• a distance judgment part for judging whether said distance information 
for each pixel is equal to or smaller than a predetermined value; 
wherein, when said distance information is judged to be equal to or 
smaller than said predetermined value, it is judged that a pixel 
corresponding to said distance information exists in said edge part or 
in said near region 

However, Futamura teaches/suggests generating distance map [Fig. 6, ref. S32; Figs. 
7A,7B, 8; Col. 6, lines 37-53]and based on the distance, determines whether a pixel is 

on or near an edge [Fig. 6, ref. S33; Col. 6, lines 54-55, 62-64]. 

The combined invention of Ishikawa, Fu, Fan and Acharya is combinable with Futamura 
because they have aspects that are from the same field of endeavor of feature 
extraction. 

At the time of the invention, it would have been obvious to one of ordinary skill in the art 
to modify the combined invention of Ishikawa, Fu and Acharya with the teaching of 
Futamura by generating a distance map and based on the distance, determining 
whether a pixel is on or near an edge. The motivation for doing so would have been 
because it offers an efficient way to identify points close to edges or borders so further 
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manipulation such as border adjustment can be performed, as Futamura indicated in 
Col. 6, lines 62-64, 

Therefore, it would have been obvious to combine Futamura with Ishikawa, Fu, Fan and 
Acharya to obtain the invention of claim 14. 

27. Regarding claim 23, it is similarly analyzed and rejected as per the analysis of 
claim 14 because it is its decoding counter part and therefore is obvious. 

* 

Contact Information 

28. Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to Yubin Hung whose telephone number is (571) 272- 
7451 . The examiner can normally be reached on 7:30 - 4:00. 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, Bhavesh Mehta can be reached on (571) 272-7453. The fax phone number 
for the organization where this application or proceeding is assigned is 571-273-8300. 
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Information regarding the status of an application may be obtained from the 
Patent Application Information Retrieval (PAIR) system. Status information for 
published applications may be obtained from either Private PAIR or Public PAIR. 
Status information for unpublished applications is available through Private PAIR only. 
For more information about the PAIR system, see http://pair-direct.uspto.gov. Should 
you have questions on access to the Private PAIR system, contact the Electronic 
Business Center (EBC) at 866-21 7-91 97 (toll-free). 



Yubin Hung 
Patent Examiner 
November 1 8, 2005 
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